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INTRODUCTION 


BACKGROUND 

A  requirement  exists  for  a  practical  Naval  Task  Force  performance  assessment 
methodology  for  evaluating  and  rank  ordering  Naval  Task  Force  architectural  options  in 
terms  of  overall  mission  performance.  The  desired  properties  of  such  a  methodology  are 
effectiveness,  timeliness,  affordability,  traceability,  repeatability  and  understandability. 
Past  performance  assessment  methodologies,  even  when  effective,  have  not  provided 
assessments  that  were  timely,  affordable,  traceable,  repeatable  or  understandable. 

A  Naval  Task  Force  is  a  very  complex  system.  A  practical  Naval  Task  Force 
performance  assessment  methodology  will  likely  be  complex  as  well.  However, 
complexity  can  often  be  understood  by  placing  the  assessment  problem  in  a  logical 
framework  composed  of  understandable  components  based  on  fleet  oriented  cognitive 
perceptions. 

A  significant  contribution  to  the  development  of  a  Naval  Task  Force  performance 
assessment  methodology  was  the  formulation  of  Mission  Success  Criteria  (MSC),  and  fleet 
oriented  Force  Performance  Metrics  (FPM)  for  the  Top  Level  Warfare  Requirements 
(TLWR)  process  by  the  Applied  Physics  Lalwratory,  the  Naval  Surface  Weapons  Center, 
and  others  circa  1985-87.  The  FPM  are:  Battle  Space,  Battle  Management,  Fire  Power, 
Countermeasures,  Sustainability,  Survivability,  Mobility,  and  Readiness.  There  are  three 
types  of  MSC:  Mission  Objectives  Accomplishments,  Capital  Resource  Losses,  and 
Expendable  Resources  Consumed.  The  FPM  are  useful  in  describing  force  architectural 
options  and  can  be  conceptually  linked  to  scenario  dependent  MSC. 

An  additional  contribution  to  development  of  a  Naval  Task  Force  performance 
assessment  methodology  was  the  development,  at  the  Naval  Coastal  Systems  Center  [1],  of 
a  methodology  for  explicitly  defining  Naval  Task  Force  functional  performance.  The 
methodology  is  based  on  a  computerized,  structured  breakdown  of  Task  Force  functional 
performance  together  with  an  explicit  identification  of  all  functional  interfaces.  This 
Computer  Aided  Systems  Engineering  (CASE)  tool  based  methodology  could  serve  as  a 
framework  for  a  computerized  standard  presentation  of  a  Naval  Task  Force  architectural 
option  (physical  implementation  option)  for  performing  the  required  Naval  Task  Force 
functions.  Quantification  of  the  performance  of  a  given  physical  option  with  respect  to 
required  functional  performance  can  then  be  evaluated  and  analytically  related  to  FPM. 

A  relationship  between  the  performance  of  a  given  Naval  Task  Force  architectural 
option  and  the  FPM,  and  the  FPM  and  the  MSC  of  a  given  mission  scenario,  can  be 
generally  obtained  through  the  exercise  of  a  performance  assessment  methodology. 

PURPOSE 

The  purpose  of  the  paper  is  to  present  a  practical  methodology  for  use  in  evaluating 
and  ranking  Naval  Task  Force  architectural  options.  The  proposed  methodology  is 
generally  based  on  Multiple  Attribute  Decision  Making  (MADM)  [2].  The  methodology  is 
presented  in  the  context  of  the  overall  Task  Force  assessment  process  defined  below. 

A  TASK  FORCE  ASSESSMENT  PROCESS 

The  Task  Force  performance  analysis  methodology  presented  is  seen  as  applicable 
to  Phase-3  of  the  four  phase  Task  Force  assessment  process  of  Figure  1.  The  Naval  Task 
Force  functional  performance  generation  methodology  developed  by  Bennett  [1]  is  seen  as 
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applicable  to  Phases  1  and  2.  Phase-4  involves  a  benefits  to  cost-risk  analysis,  a  final 
Naval  Task  Force  architectural  option(s)  selection  process,  and  documentation  of  the 
results.  Assessment  process  details  are  shown  in  Appendix  B  Figures  B 1  through  B4. 


FIGURE  1 .  A  NAVAL  TASK  FORCE  ARCHITECTURE  ASSESSMENT  PROCESS 


A  TASK  FORCE  PERFORMANCE  ANALYSIS 

After  careful  consideration  of  the  numerous  MADM  methodologies,  the  Analytic 
Hierarchy  Process  (AHP)  of  Thomas  L.  Saaty  [3]  has  been  selected  as  the  methodology  for 
defining  a  practical  Naval  Task  Force  performance  analysis  for  Phase-3  of  an  assessment 
process.  The  context  of  the  AHP  in  the  array  of  available  MADM  methodologies  is 
presented  in  Appendix  A,  along  with  related  mathematical  techniques,  etc.  The  following 
presentation  makes  no  mathematical  demands  on  the  reader.  Required  elements  of 
Appendix  A  will  be  evoked  by  reference  where  needed. 

Saaty  [3]  outlines  explicit  steps  for  the  conduct  of  an  AHP  analysis  using  groups  of 
decision  makers  (expert  panels).  A  specific  AHP  formulation  for  a  proposed  Naval  Task 
Force  Performance  analysis  plan  using  Saaty's  steps  follows. 

The  first  step  is  to  define  the  problem  and  specify  the  nature  of  the  desired  solution. 
The  problem  posed  is:  Select  the  "best"  physical  implementation  option  (alternativel  for  a 
Naval  Task  Force  functional  architecture  from  among  several  explicitly  defined 
alternatives.  "Best"  is  specified  as  the  alternative  with  the  highest  "overall"  mission 
effectiveness  among  the  alternatives.  "Overall"  is  defined  as  the  aggregate  mission 
effectiveness  taken  over  a  set  of  potential  mission  scenarios. 

The  second  step  is  to  develop  and  structure  an  AHP  hierarchy  from  a  top  level 
overall  Naval  Force  procurement  point  of  view  down  to  a  level  at  which  procurement  of 
physical  components  comprising  a  set  of  Naval  Task  Force  architectural  options  or 
physical  options  /  alternatives  can  be  explicitly  considered  in  a  procurement  process. 

Proposed  AHP  hierarchy  levels  are  described  as  follows: 

Level  "0",  the  top  level,  consists  of  a  single  attribute.  Task  Force  Mission 

Effectiveness,  derived  from  the  results  of  Step-1. 

Levels  "1"  consists  of  Regional  War,  and  Global  War. 

Level  "2"  consists  of  Sea  Control,  Power  Projection,  and  Sealift/SLOC  Protection. 

Note  that  Levels  "1"  and  "2"  combine  to  delineate  a  set  of  six  generic  mission 

scenarios,  i.e.  Sea  Control  in  a  Regional  War,  Power  Projection  in  a  Regional 

War,  Sealift/SLOC  Protection  in  a  Regional  War,  Sea  Control  in  a  Global  War, 

Power  Projection  in  a  Global  War,  and  Sealift/SLOC  Protection  in  a  Global  War. 
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Level  "3"  is  comprised  of  the  Force  Performance  Metrics  (FPM),  i.e.  Battle  Space, 
Battle  Management,  Fire  Power,  Countermeasures,  Sustainability,  Survivability, 
Mobility,  and  Readiness. 

Level  "4"  is  comprised  of  the  current  Naval  Warfare  Tasks  supplemented  by  Anti 
Space  Warfare  (ASPW)  and  Radio  and  Electronic  Combat  (R&EC).  The  current 
Naval  Warfare  Tasks  are  of  two  classes,  fundamental  tasks  and  supporting  tasks. 
The  fundamental  tasks  are  anti-air  warfare  (AAW),  anti-submarine  warfare  (ASW), 
anti-surface  warfare  (ASUW),  strike  warfare  (STW),  amphibious  warfare  (AMW), 
and  mine  warfare  (MIW).  The  supporting  tasks  are  special  warfare  (NSW),  ocean 
surveillance  (SURV),  intelligence  (INTEL),  command,  control  and 
communications  (C3),  electronic  warfare  (EW),  and  logistics  (LOG).  Note  that 
rational  clusters  of  the  Naval  Warfare  Tasks  might  be  considered  to  simplify  this 
level. 

Level  "5"  is  derived  from  observing  the  utility  of  a  generic  set  of  "lower"  level 
functional  decomposition  attributes  in  previous  Warfare  Task  functional 
decompositions  [1,  4],  i.e.  Receive,  Sense,  Plan,  Observe,  Assess,  Execute,  Issue, 
and  Act.  Appendix  C  includes  definitions  of  these  generic  fundamental  or  primitive 
functions.  Level  "5"  is  comprised  of  a  set  of  eight  fundamental  or  primitive 
functions  for  each  Naval  Warfare  Task  considered.  If  clusters  of  Naval  Warfare 
Tasks  are  considered,  there  would  only  be  one  set  of  eight  fundamental  or  primitive 
functions  for  each  cluster  considered.  Thus  clustering  would  simplify  this  level  as 
well. 

Level  "6",  the  bottom  level  is  comprised  of  the  physical  options  /  alternatives 
to  be  evaluated  using  the  proposed  AHP  hierarchy. 

Figure  2  is  a  diagram  of  the  proposed  hierarchy. 

A  proposed  structural  mappings  between  levels  of  the  hierarchy  are  shown  in 
Figures  3-5.  Figure  3  indicates  the  proposed  hierarchical  structure  for  levels  "0"  through 
"3"  .  This  portion  of  the  hierarchy  is  composed  entirely  of  attributes  of  a  functional 
nature,  and  is  thus  "functional"  as  defined  and  required  by  the  AHP  .  The  hierarchy  is  also 
"complete",  as  defined  by  the  AHP,  since  all  attributes  at  a  given  level  connect  to  every 
attribute  at  the  next  higher  level  [3].  This  hierarchical  structure  defines  an  explicit  linear 
mathematical  relationship  between  the  FPM  and  the  MSC  effectiveness  criterion.  The 
nature  of  this  Hierarchcial  Additive  Weighting  (HAW)  relationship  is  discussed  in 
Appendix  A.  The  procedure  for  analytically  obtaining  the  relative  importance  (weighting) 
of  an  attribute  at  a  given  level  with  respect  to  an  attribute  at  the  next  higher  level  is 
addressed  in  later  steps.  Appendix  A  provides  the  necessary  mathematical  details. 
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FIGURE  2:  A  NAVAL  TASK  FORCE  ASSESSMENT  HIERARCHY 
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Representative  sub-structure  mappings  for  the  remaining  hierarchical  levels  are 
shown  in  Figures  4  and  5. 


FIGURE  4.  TASK  FORCE  HIERARCHY  LEVELS  “3.1"  [BATTLE  SPACE]  TO  LEVEL  “4" 


The  hierarchical  structure  in  Figure  4  maps  Battle  Space  to  Level  "4".  The  mapping 
structures  for  the  other  seven  (7)  Level  "3"  FPM  attributes  to  Level  "4"  attributes  are 
identical  to  the  structure  for  Battle  Space  shown  in  Figure  4.  Thus  the  Level  "3”  to  Level 
"4"  hierarchical  structure  is  both  "functional"  and  "complete"  as  defined  by  the  AHP. 


Uvel  "4.1- 


The  Level  "4"  to  Level  "5"  hierarchical  structure  is  "functional"  but  not  "complete” 
.  It  is  not  "complete"  because  the  eight  (8)  Level  "5”  attributes  specifically  related  to 
A  AW  in  Figure  5  do  not  map  to  the  other  thirteen  (13)  Level  "4"  Warfare  Task 
attributes,  e.g.  ASW,  MIW,  LCKj,  etc.  The  structures  for  the  other  thirteen  (13)  Level 
”4'  Warfare  Task  attributes  to  their  related  eight  (8)  Warfare  Task  specific  Level  ”5’ 
attributes  are  similar  to  the  structure  for  AAW  in  Figure  5,  and  are  also  "functional"  but 
not  "complete"  ,  e.g.  ASW  is  not  mapped  to  MIW  Plan,  etc.  Thus  the  level  "4"  to  Level 
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"5"  hierarchical  structure  is  "functional"  but  not  "complete" .  Note,  there  is  a  total  of  eight 
times  fourteen  (8x14)  or  one-hundred  twelve  (112)  Level  "5"  attributes  ranging  from 
AAW  Receive  to  R&EC  Act. 

The  cross  Warfare  Task  types  of  mapping  relationships  are  omitted  from  the 
structure  by  design  to  reduce  the  scope  and  magnitude  of  the  AHP  analyses.  The  omitted 
mappings  could  be  added  if  time  and  resources  permit.  However,  such  an  AHP  hierarchy 
enhancement  may  not  be  worth  the  added  effort,  as  will  be  seen  in  step  3. 

The  hierarchical  structure  for  Levels  "5"  to  "6"  is  "complete",  but  not  composed 
entirely  of  functional  attributes.  The  Level  "5"  attributes  are  functional  in  nature, 
i.e. "functional".  However,  Level  "6"  is  not  functional  in  nature.  In  fact  it  is  not 
composed  of  attributes  at  all.  Level  "6"  is  composed  of  the  physical  options  / 
alternatives  to  be  evaluated  by  the  AHP.  The  "bottom"  level  is  the  only  AHP  hierarchy 
level  that  need  not  be  functional  in  nature. 

The  third  step  is  to  construct  the  pair-wise  relative  preference  ratio  matrices 
necessary  to  analytically  calculate:  (1)  the  relative  importance  (weights)  of  attributes  at  a 
given  level  with  respect  to  a  given  attribute  at  the  next  higher  level,  and  (2)  the  relative 
capability  (weights)  of  alternatives  at  the  lowest  level  with  respect  to  a  given  attribute 
at  the  next  higher  level,  i.e.  at  the  next  to  the  lowest  level  of  the  hierarchy. 

Level  "0"  is  the  top  level  and  requires  the  construction  of  no  pair-wise  relative 
preference  ratio  matrices  since  the  importance  of  its  single  attribute.  Mission 
Effectiveness,  is  trivially  one  (1.0). 

Level  "  1 "  requires  one  2x2  matrix  construction,  involving  the  relative  importance 
(weight)  of  Regional  War  and  Global  War  capabilities  with  respect  to  overall  Mission 
Effectiveness. 

Level  "2"  requires  two  3x3  matrix  constructions.  The  two  3x3  pair-wise  relative 
preference  ratio  matrices  constructions  required  are:  (1)  a  pair-wise  relative  preference 
ratio  matrix  for  the  three  level  "2"  attributes.  Sea  Control,  Power  Projection; 
Sealift/SLOC  Protection  with  respect  to  their  relative  importance  (weight)  in  a  Regional 
War,  and  (2)  a  separate  3x3  pair-wise  relative  preference  ratio  matrix  for  Sea  Control, 
Power  Projection;  Sealift/SLOC  Protection  with  respect  to  their  relative  importance 
(weight)  in  a  Global  War. 

The  number  of  pair-wise  relative  preference  ratio  matrices  required  for  any  given 
hierarchical  level  is  the  number  of  hierarchical  attributes  mapped  onto  in  the  next  higher 
hierarchical  level.  The  dimensions  of  a  pair-wise  relative  preference  ratio  matrix  is  the 
number  of  attributes  (alternatives  at  the  "bottom"  level)  mapped  at  the  given 
hierarchical  level.  Thus: 

(1)  Level  "3"  requires  three  8x8  matrix  constructions, 

(2)  Level"4"  requires  eight  14x14  matrix  constructions, 

(3)  Level  "5"  requires  fourteen  8x8  matrix  constructions; 

(4)  Level  "6"  requires  one-hundred  twelve  NxN  matrix  constructions,  where  N  is 

the  number  of  alternatives  being  considered. 
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Note:  Eight  Warfare  Task  specific  fundamental  attributes  times  fourteen  Warfare 

Tasks  is  one-hundred  twelve. 

In  all  a  total  of  140  separate  pair-wise  relative  preference  ratio  matrices 
constructions  are  required  for  the  proposed  AHP  hierarchy.  The  construction  of  140 
matrices  is  not  a  simple  task.  However,  given  the  complexity  of  a  Naval  Task  Force,  140 
is  a  modest  number. 

The  Level  "5"  matrix  constructions  would  have  involved  fourteen  1 12x1 12  matrix 
constructions  if  the  hierarchy  had  been  structured  to  be  complete.  Significant  savings  in 
both  personnel  resources  and  computer  capability,  not  to  mention  time,  are  achieved  by  the 
incomplete  hierarchical  structure  suggested.  The  selection  of  a  reasonably  small  number  of 
alternatives.  N,  in  Phase-2  of  the  overall  Naval  Task  Force  assessment  process  can 
produce  substantial  efficiencies  as  well.  Values  of  N  greater  than  four  or  five  may  be 
impractical.  Values  of  N  above  nine  are  not  recommended.  Other  efficiencies  may  be 
gained  by  clustering  some  of  the  fourteen  Warfare  Tasks  of  Level  "4"  into  "clustered" 
Warfare  Tasks.  If  reasonable,  such  a  clustering  resulting  in  nine  or  less  Level  "4" 
attributes  might  be  considered.  This  would  provide  addition^  efficiencies  in  the  AHP. 

An  individual  pair-wise  relative  preference  ratio  matrix  ,  R,  must  be  generated  for 
the  hierarchical  attributes  of  a  given  level  with  respect  to  a  criterion  set  by  a  related 
hierarchical  attribute  of  the  next  higher  hierarchical  level.  In  a  given  pair-wise  relative 
preference  ratio  matrix,  R,  an  attributes  ratio  ,  rjj  .is  by  convention  a  measure  of  the 
dominance  of  the  i  th  hierarchical  attribute  of  a  given  level  over  the  j  th  hierarchical 
attribute  of  that  level  with  respect  to  the  criterion  set  by  a  given  hierarchical  attribute  of 
the  next  higher  hierarchical  level.  Similarly,  an  individual  pair-wise  relative  preference 
ratio  matrix  ,  R,  must  be  generated  for  the  hierarchical  alternatives  of  the  "bottom"  level 
with  respect  to  a  criterion  set  by  a  related  hierarchical  attribute  of  the  next  to  the  "bottom" 
hierarchical  level.  As  noted  above,  the  object  of  the  construction  of  a  pair-wise  relative 
preference  ratio  matrix  is  to  be  able  to  find  the  relative  importance  (weight)  of  each  of  the 
appropriate  hierarchical  attributes  of  a  given  level  (alternatives  at  the  "bottom"  level) 
with  respect  to  a  related  hierarchical  attribute  at  the  next  higher  level. 

Procedures  for  generating  a  relative  preference  ratio  matrix,  and  finding  consistent 
estimates  of  the  required  associated  attribute  preference  weights  are  presented  in 
Appendix  A.  The  Saaty  pair-wise  relative  preference  ratio  scale,  and  the  Eigenvector 
Method  for  analytically  finding  weights  from  a  pair-wise  relative  preference  ratio  matrix 
found  in  Appendix  A  are  the  analytical  foundations  of  Saaty's  AHP  version  of  the 
Hierarchical  Additive  Weights  (HAW)  process.  The  independence  or  interdependence  of 
attributes  at  a  given  level  is  also  a  real  concern  in  the  development  of  a  hierarchy  and  the 
related  preference  ratio  matrices.  For  a  discussion  of  how  the  AHP  addresses 
interdependencies  among  attributes  see  Saaty  [3]. 

Step  four  involves  the  development  of  numerical  estimates  of  the  pair-wise 
preference  ratios  for  the  relative  preference  ratio  matrices  developed  in  step  three. 

Step  four  is  the  most  important  and  labor  intensive  step  in  AHP.  It  must  be 
carefully  planned,  and  executed.  The  numerical  estimates  must  reflect  the  considered 
judgments  of  decision  makers  at  the  appropriate  military  and  political  level.  The  decision 
makers  from  the  various  levels  must  be  willing  and  able  to  make  an  appropriate  effort  to 
develop  consistent  numerical  estimates. 
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Multiple  judgements  of  the  numerical  estimates  for  a  given  matrix  by  an  appropriate 
group  of  decision  makers  (expert  panel)  is  highly  desirable.  A  single  set  of  numerical 
judgements  for  a  given  matrix  can  be  obtained  by  group  consensus,  e.g.  use  of  a  Delphi 
procedure  [5] .  Multiple  judgements  can  also  be  synthesized  by  calculating  the  geometric 
mean  as  suggested  by  Saaty  [3].  The  use  of  both,  where  the  geometric  mean  is  used 
following  each  iteration  of  a  Delphi  procedure  is  suggested  to  facilitate  convergence  to  a 
consistent  group  consensus. 

Separate  groups  of  decision  makers  (expert  panels)  are  suggested  for  the 
development  of  the  numerical  estimates  of  matrices  required  for  the  various  levels  of  the 
AHP  hierarchy.  For  example,  some  Level  "0"  through  Level  "2"  related  matrices  might 
require  a  group  of  decision  makers  from  DOD,  the  CINCs;  and  CNO.  Some  Level  "2" 
through  Level  "4"  related  matrices  might  require  a  group  of  decision  makers  from  the 
CINCs,  OPNAV,  and  the  SYSCOMs.  The  Level  "4"  through  Level  "6"  related  matrices 
might  require  several  groups,  each  composed  of  decision  makers  who  are  experts  in  a 
given  Warfare  Task  from  the  CINCs,  OPNAV;  and  the  SYSCOMs.  This  is  not  to  suggest 
140  different  groups.  However,  some  hierarchical  formulation  of  groups  based  on  the 
military  and  political  scope  and/or  AHP  hierarchical  level  associated  with  the  matrix  being 
addressed  is  highly  recommended. 

Step  five  can  begin  once  a  group  has  come  to  an  initial  consensus  on  the  numerical 
estimates  of  an  assigned  matrix.  In  fact  step  five  can  and  should  begin  well  before  all  the 
groups  have  come  to  an  initial  consensus  for  all  the  matrices  required. 

As  agreed,  consensus  matrices  become  available  from  a  group,  the  AHP  analysts 
can  begin  calculating  estimates  of  the  attribute  priorities  (weights)  for  a  given  agreed  matrix 
and  test  the  consistency  of  the  pair-wise  preference  ratio  estimates  of  the  agreed  matrix. 
The  appropriate  AHP  mathematical  procedures  are  found  in  Appendix  A.  In  general,  the 
procedures  could  be  performed  in  a  few  minutes  on  a  personal  computer  ,  e.g.  using 
standard  AHP  software,  or  general  mathematical  software  such  as  MathCAD.  In  fact,  with 
sufficient  computer  resources  and  software,  the  required  procedures  could  be  performed  as 
an  integral  part  of  the  group's  activities.  This  would  most  certainly  facilitate,  in  near  "real 
time" ,  the  convergence  of  a  group  to  a  set  of  consistent  agreed  matrices  and  associated 
attribute  weights. 

Step  six  is  the  consolidation  of  the  final  results  of  steps  three,  four,  and  five. 

Step  seven  is  performed  by  the  AHP  analysts.  It  involves  using  the  AHP  related 
Hierarchical  Additive  Weights  procedures  discussed  in  Appendix  A  to  calculate  an  IxN 
Mission  Effectiveness  priority  vector  for  the  N  considered  Task  Force  Architectural 
alternatives. 

Step  eight  is  the  evaluation  of  the  consistency  of  the  entire  hierarchy.  This  is  done 
by  first  multiplying  each  ratio  matrix's  consistency  index.  Cl,  calculated  in  step  five  by  the 
priority  (weight)  of  the  corresponding  criterion,  i.e.  the  associated  next  higher  level 
alternative  established  criterion,  and  adding  the  products  to  find  the  overall  hierarchy 
consistency  index.  Next  repeat  the  above  calculation  using  corresponding  random  ratio 
matrix  consistency  Index  values  from  Appendix  A  in  place  of  the  ratio  matrix  consistency 
indices  used  above  to  find  the  overall  random  consistency  index.  The  consistency  ratio  for 
the  entire  hierarchy  is  the  consistency  index  for  the  overdl  hierarchy  divided  by  the  overall 
random  consistency  index  [3].  If  the  overall  consistency  ratio  is  greater  than  0.1  ( 10%), 
then  the  overall  quality  of  the  ratio  matrix  numerical  estimates  should  be  improved,  and/or 
the  hierarchical  structure  is  flawed.  If  this  is  the  case,  an  iteration  of  the  AHP  beginning 
again  with  step  two  is  indicated.  Otherwise,  an  initial  analysis  process  has  been  completed. 
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COMMENTS  AND  RECOMMENDATIONS 

The  specific  Task  Force  performance  analysis  plan  outlined  above  is  provided  as  a 
demonstration  of  the  utility  of  the  AHP  methodology.  It  is  a  preliminary  first  cut .  It  can 
serve  as  a  starting  point  for  the  formal  development  of  a  decision  m^er  guided,  AHP 
analyst  planned,  Naval  Task  Force  performance  analysis  process  based  on  the  AHP 
Methodology. 

The  design  and  implementation  of  an  AHP  is  not  a  step  by  step  rote  process.  It  is  an 
art!  When  and  if  the  AHP  is  selected  for  use  as  a  Task  Force  performance  analysis 
process,  the  appropriate  decision  makers,  and  analysts  skilled  in  the  AHP  art  should  sit 
down  together  and  develop  an  explicit  analysis  plan  that  follows  the  AHP  steps  as  outlined 
by  Saaty. 

The  proposed  Task  Force  performance  analysis  methodology  is  viewed  as: 

(1)  Effective  in  that  it  is  addresses  the  central  problem  and  provides  for  a  solution 
methodology  that  involves  the  key  decision  makers  in  its  design  and 
implementation.  The  AHP  also  builds  consensus  in  a  straight  forward  way. 

(2)  Timely  in  that  the  initial  design  and  implementation  phase  should  take  less  than 
a  year.  Follow  on  iterative  use  of  the  design  would  only  require  assessments  of  the 
ratio  matrices,  and  calculation  of  weights  for  the  new  alternatives  of  Level  "6" 
considered  in  a  follow  on  POM  cycle  assessment.  Unless  there  are  significant 
changes  in  the  national  interests,  and  associated  policy  and  grand  strategy  changes, 
the  level  "5"  and  above  attribute  weights  need  not  be  recalculated.  Thus,  iteration 
of  the  proposed  process  should  be  executable  in  less  than  six  months. 

(3)  Traceable  and  repeatable  due  to  the  inherent  in  the  formal  analytical  nature  of 
the  AHP  methodology. 

(4)  Understandable  in  that  the  AHP  methodology  combines  two  fundamental  and 
intuitively  appealing  approaches  to  problem  solving:  (1)  the  systems  approach  with 
its  focus  on  a  system  as  a  whole,  and  (2)  the  deductive  reasoning  approach  of 
applied  science  with  its  focus  on  the  component  parts  of  a  system. 

The  demonstrated  utility  provided  above,  and  the  practical  nature  of  the  AHP 
methodology,  recommend  its  adoption  for  Task  Force  performance  analysis. 
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MULTIPLE  ATTRIBUTE  DECISION  MAKING  FORMULATIONS 


GENERAL  FORMULATION 

A  general,  generic,  matrix  algebra  formulation  of  Multiple  Attribute  Decision 
Making  (NL\DM)  is  presented. 

Let  D  =  [  dij  ]  be  an  m  x  n  decision  matrix  where  m  is  the  number  of  decision 
making  alternatives  (rows),  and  n  is  the  number  of  attributes  (columns)  ascribed 
to  an  alternative.  Let  the  row  vector 


di.  =  [  dii, ... ,  din  ] 


be  the  n  attribute  (column)  values  for  alternative  i.  Let  column  vector 

d.jT  =  [dij,...,dinj]T 

be  the  m  alternative  (row)  values  for  attribute  j. 

Let  fk  be  the  k^h  objective  function  of  a  set  of  p  decision  objectives.  For  the  i^ 
alternative  of  a  set  of  m  alternatives,  let 

=  F(dii, ... ,  din  I  given  an  alternative  i ) . 

TTie  alternative,  i'k  that  gives 


Ik  = 


max 
i 


is  the  alternative  that  is  an  "optimal"  decision  with  respect  to  objective  k.  If  i'k  is  the  same 
alternative,  i*,  for  all  objectives,  k=l,  2,...,  p,  then  alternative  i*  is  the  "optimal"  decision 
of  a  MADM  process.  Note,  i*  is  "optimal"  only  with  respect  to  the  set  of  objectives 
defined  by  the  set  of  objective  functions  {fi,...,  fp).  Such  a  unique  alternative  as  i* 
generally  does  not  exist  in  practice.  If  it  did,  there  would  be  no  conflict  among  the 
alternatives,  and  the  MADM  process  would  be  straight  forward  and  simple. 

MADM  WITH  "NON-OPTIMAL”  ALTERNATIVES 

The  array  of  methods  for  MADM  is  extensive.  Preferred  methods  depend  on  the 
type  of  information  available  to  the  decision  maker  and  the  salient  features  and  nature  of  the 
information  [1].  If  attribute  preference  information  is  known  or  estimatable  with  respect  to 
a  cardinal  scale,  several  methods  are  potentially  useful.  The  methods  discussed  are  the 
Simple  Additive  Weighting  (SAW)  method,  and  the  Hierarchical  Additive  Weighting 
(HAW)  method.  A  discussion  of  the  Linear  Assignment ,  Elimination  et  Choice  Translating 
Reality  (ELECTRE),  and  Technique  for  Order  Reference  by  Similarity  to  Ideal  Solutions 
(TOPSIS)  methods  can  be  found  in  Hwang  and  Toon  [1]. 

The  Weighted  Least  Square  and  Eigenvector  methods  for  estimating  attribute 
preference  information,  i.e.  normalized  weights,  from  an  attribute  pair-wise  preference 
matrix,  and  observed  attribute  values  transformation  and  normalization  procedures  are  also 
presented. 
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ATTRIBUTE  PREFERENCE  ESTIMATION  METHODS 

The  considered  MADM  methods  all  require  attribute  preference  information.  This 
information  is  assumed  to  be  available  as  cardinal  scale  data.  Preference  data  is  usually 
expressed  by  a  set  of  attribute  preference  weights  which  are  greater  than  zero  and 
normalized  so  that  their  sum  over  dl  attributes  is  one.  Thus,  for  or  n  attributes,  let  the  set 
of  weights,  wj  >  0,  form  a  1  x  n  matrix 

W  =  [W1,W2, ...  ,wj . wn] , 

where 

n 

]£wi  =  1. 

i=1 

The  "true"  weights  are  usually  not  known  explicitly,  and  thus  must  be  estimated. 
If,  however,  the  "true"  weights  were  known,  then  a  pair-wise,  relative  preference  ratio, 
matrix,  R,  could  be  written  as  an  n  x  n  matrix 


Thus,  an  estimate  of  the  ratio  matrix,  R,  can  be  expressed  as  A  =  [  rjj  ] ,  where  rjj  is  an 
estimate  of  the  pair-wise  ratio  [  Wj  /  Wj  ] . 

A  recommended  pair-wise,  relative  preference,  ratio  scale  is  the  Saaty  scale  [1,2] 
presented  below: 

Where  the  row  i  attribute  dominates  a  column  j  attribute  with  respect  to  a 
given  criteria,  for  a  given  attribute  pair  and  objective  function,  f  jj  is  set  to  the 
following  values; 

rjj  =  1  for  equal  importance  of  attributes  for  the  given  objective  function, 

rjj  =  3  for  weak  importance  of  attribute  i  over  attribute  j , 

^ jj  =  5  for  adjudged  strong  importance  of  attribute  i  over  attribute  j , 

* 

rjj  =  7  for  demonstrated  strong  importance  of  attribute  i  over  attribute  j ; 
tjj  =  9  for  absolute  importance  of  attribute  i  over  attribute  j . 

The  values  tjj  =  2,  4,  6,  or  8  are  assigned  when  intermediate,  compromise  values, 
for  the  importance  of  attribute  i  over  attribute  j  arc  needed. 

Where  the  row  i  attribute  is  dominated  by  a  column  j  attribute  with 
respect  to  a  given  criteria,  for  a  given  attribute  pair  and  objective  function,  rjj  is  set 
to  the  following  values: 

?jj  =  1  for  equal  importance  of  attributes  for  the  given  objective  function, 
fij  =  1/3  for  weak  importance  of  attribute  j  over  attribute  i , 
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tij  =  1/5  for  adjudged  strong  importance  of  attribute  j  over  attribute  i , 

A  ^  •  • 

rjj  =  1/7  for  demonstrated  strong  importance  of  attribute  j  over  attribute  i  ; 
fjj  =  1/9  for  absolute  importance  of  attribute  j  over  attribute  i . 

The  values  fjj  =  1/2,  1/4,  1/6,  or  1/8  are  assigned  when  intermediate,  compromise 

values,  for  the  importance  of  attribute  j  over  attribute  i  are  needed. 

Note  that  the  above  scale  maintains  the  reciprocal  property  f  jj  =  [  1  / 1 jj  ]  of  the 
ratio  matrix,  R,  in  its  estimate  A  .  Thus  only  the  upper  diagonal  of  A  needs  to  be 
estimated,  since  the  diagonal  values  of  A  are  trivially  one. 

To  find  a  Weighted  Least  Square  method  estimate  W  of  W,  for  a  given  A,  let  an 
error  of  the  estimate  term  be 


e*ij  =  (  rjj  -  rjj  ) . 

or  equivalently,  since  0  <  wj  1, 

ej]  =  e*ij  wj  =  (  rjj  wj  -  wj  ). 


Using  ejj  as  an  error  of  the  estimate  term,  let 


,A,  min  H  ,  ,0  min 

=  {W}  ?  .  =  {W} 


I  I  (  ^ij  Wj  -  Wj  )2  , 
i=  j=1 


with  the  constraint 


n 

= 

i=1 


1 


A  solution,  W  ,  to  the  above  minimum  least  squares  equation  with  its  constraint  can 
be  found  by  solving  for  the  extreme  (minimum)  of  the  associated  Lagrangian  function 

L(wi, ... ,  wn,  X )  =  I  I  (  ^ij  Wj  -  Wj  )2  +  2  X.  ( (  I  wj )  - 1  ), 
i=j=1  j=1 

where  X,  is  a  Lagrangian  multiplier.  As  a  result,  W,  is  obtained  by  solving  the  matrix 
equation  [1]. 


[wi  ,  ...  .wn,X]'r  =  [bjj]-llO . 0,1]T. 


where  B  =  [  bjj  ]  is  an  (n+1 )  x  (n+1 )  symmetric  matrix  defined  by 
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bij  =  -( tjj  +  tji )  for  i  =  1 . n  ,  j  =  1 . n,  and  I  ^  j, 

(i.e,  for  a  given  fixed  i  and  j  ^  i ,  let  j  =  1 , ,n  to  generate  the  off  diagonal  elements  for 
both  i  and  j  less  than  or  equal  to  n), 

bk,(n+1)  =  b(n+l),k  =  1  for  k  =  1 . n, 

bii  =  (n-1)+  I  (tki  )2  fori=j:i  =  1 . n, 

k=l  :k^i 

(i  .e.,  for  a  given  fixed  i ,  let  k  =  1 , ... ,  1-1 ,  i+1 . n 

to  generate  the  diagonal  elements  for  i  =  1 , ... ,  n), 

and 

b(n+1),(n+1)  =  0. 

From  the  above,  the  matrix  equation,  B,  for  n  =  3  is 


b11 

b12 

b13 

b14 

b21 

b22 

b23 

b24 

b31 

b32 

b33 

b34 

b41 

b42 

b43 

b44 

bi  1  =  2  +  {  ^21  . 

b22  =  2+  {^12  )2  +  (^2  )2, 
b33  =  2+  (  ri3  )2  +  { r23  )^ . 
b21  =bi2  =  -  {  ^21  +^12). 
b31  =bi3  =  -  (  +  ^3  ). 

b32  =  b23  =  -  (  hz  +  r23  ) . 
b41  =  b42  =b43=bl4=b24=b34=  1  : 
b44  =  0  . 

Thus, 

[  W1  ,  W2  ,  W3  .>.]'•’=[  bij ]  -1  [  0,  0,  0, 1  ]T 
To  find  an  Eigenvector  method  estimate  W  of  W,  for  a  given  A,  note  that 


R 
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is  a  "reciprocal  matrix"  with  all  positive  elements.  Note  also  that  R  is  consistent  in  that 
,  ,,  ,  /WiwWkN  /Wk 

(rik)(rkj)  =  (Wkj  [wj'J  =  (Wj j  =  '^'j  • 

Forming  the  matrix  equation  below  yields  the  interesting  result 

R  X  WT  =  ( [  wi .  W2. ... ,  wj . wn] =  n  . 

or 

(  R  -  n  I )  WT  =  0, 
where  I  is  the  nxn  identity  matrix. 

The  eigenvalue,  eigenvector  pairs  of  R  are  solutions  to  the  matrix  equation 

(R-A.i)^T  =  0. 

thus  {  n  ,  W  }  is  an  eigenvalue,  eigenvector  pair  of  R.  In  fact  it  is  the  only  and  trivial 
solution  due  to  the  consistency  property  of  R. 


In  general  A  is  not  perfectly  consistent  However,  the  reciprocal  property  of  A  , 
and  a  careful  estimation  of  its  elements  by  experts  should  make  the  estimated  pair-wise  ratio 
elements  closer  to  consistent  than  to  being  random  numbers.  Thus  if  we  solve 

(  A-  >,I)4T  =  0, 

for  Xmax  and  its  associated  eigenvector  ^  then  for  a  reasonably  consistent  A  an 
estimate  of  W  is  given  by 


Saaty  [2]  suggests  that  an  index  of  the  consistency  of  A  is  given  by 
Cl  =  I  (  Xmax  -  n  )  I  /  2  . 

Saaty  has  calculated  expected  Cl  values  for  random  reciprocal  matrices  of  size  n. 
Saaty's  Cl  values  for  random  consistency  give: 


matrix  size  n1  2  3  4  5  6  7  8  910 

CIrandom  0.00  0.00  0.58  0.90  1.12  1.24  1.32  1.41  1.45  1.49 
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Saaty  defines  a  consistency  ratio,  CR  as 

CR  =  Cl  ( Xmax  .  n)  /  Clrandom(n) . 

CR  values  of  1 0%  (0. 1 )  or  less  are  desirable  for  n  >  3.  If  this  is  not  the  case  the  quality 
of  the  associated  A  matrix  is  suspect  and  A  should  be  re-estimated  [2]. 

An  estimation  of  the  weights,  W  ,  by  the  prudent  selection  of  an  attribute  weights 
estimation  method  is  critical  to  creditable  MADM  results.  A  poor  or  biased  procedure  can 
and  will  adversely  effect  MADM  outcomes.  The  use  of  one  or  both  of  the  above  analytic 
methods  ( vice  an  ad-hoc  or  "group  grope"  procedure)  is  recommended. 

DECISION  MATRIX  TRANSFORMATION  AND  NORMALIZATION 

The  considered  methods  all  utilized  a  "best"  alternative  selection  method  based  on 
an  evaluation  of  objective  functions.  The  objective  function  calculations  all  utilize 
quantitative  attribute  weights  information,  and  comparable,  e.g.  linear,  monotonic, 
normalized,  quantified  attribute  values. 

For  n  attributes  and  m  alternatives  let  DO  be  an  m  x  n  decision  matrix  of 
observed  attribute  values  over  all  alternatives.  A  transformation  procedure  converts  the 

observed  (quantitative  or  qualitative  /  fuzzy)  attribute  values,  cJOj]  ,  into  quantified 
measurement  scale  values,  xjj. 

For  linear,  monotonic,  quantitative  observed  attribute  values,  transformation  is 
trivial.  In  general,  values  are  usually  directly  observed  as  quantitative  scale  values. 
Examples  are: 

(1)  Ordinal  scale,  rank  order  value  of  an  attribute  vis-a-vis  an  alternative  with 
respect  to  the  other  alternatives. 

(2)  Relative  numerical  scale  value  of  the  distance  with  respect  to  some  arbitrary 
origin  for  an  attribute  vis-a-vis  an  alternative. 

(3)  Absolute  numerical  scale  value  of  the  distance  with  respect  to  a  non-arbitrary 
origin  for  an  attribute  vis-a-vis  an  alternative. 

A  numerical  scale  value  may  be  either  the  total  distance  from  the  origin  for  a  given  attribute 
vis-a-vis  an  alternative,  or  the  relative  distance  (difference)  along  the  scale  for  a  given 
attribute  vis-a-vis  an  alternative  relative  to  the  other  alternatives. 

If  the  d°ij  values  for  a  given  attribute  j  are  not  monotonic,  but  are  monotonic,  or 
better  yet  linear  monotonic,  in  a  function  FJ(dOij),  then  it  is  desirable  to  let  xy  =  FJ(  d^jj ) 
be  a  transformation  process  for  attribute  j .  Examples  are: 

(1)  Monotonic  or  linear  in  the  Log,  where 

Xjj  =  Log  { dOjj  I  fixed  j), 
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(2)  Monotonic  or  linear  in  the  root,  where 

xij  =  (dOijl  fixed 

(3)  Monotonic  or  linear  in  the  exponential  of  e  where 

xjj  =  exp  ( dOjj  I  fixed  j) ; 

(4)  Monotonic  or  linear  in  the  quadratic,  where 

xij=ao  +  ai  (dOjj  |  fixed  j)  +a2(dOij  |  fixed  j)2. 

Such  transformations  assure  that  transformed  attribute  values  are  monotonic,  i.e.  "more  is 
better"  or  "more  is  not  better." 

Qualitative  /  fuzzy  observed  attributes  must  be  quantified.  The  simplest  monotonic 
quantification  scheme  is  to  use  an  ordinal  scale,  e.g.  rank  order  of  an  attribute  over  the 
alternatives.  A  useful  Xjj  monotonic  relative  numerical  scale  for  a  given  attribute  j  is: 


1-2-3  4-5-6  7-8-9 


where  for  "more  is  better"  attributes 
and 


1-2-3 


is  the  low  range. 


4-5-6 


7-8-9 


is  the  high  range.  For  "more  is  not  better"  attributes,  such  as  cost. 


is  the  mid  range, 
is 


1-2-3 


the  high  range,  and 


7-8-9 


is  the  low  range.  If  necessary,  the  values  0  and  1 0  can  be 


used  for  extreme  values,  e.g.  the  minimum  and  maximum  realizable  values.  Quantification 
by  an  absolute  numerical  scale  is  not  generally  practical  due  to  the  fuzzy  nature  of  a 
qualitative  attribute. 


Normalization  is  used  to  convert  the  various  attribute  scales  into  comparable,  e.g. 
normalized  /  "unit-less"  ,  scales  of  similar  length.  This  facilitates  objective  function 
computations,  since  objective  function  calculations  all  utilize  quantitative  attribute  weights 
information,  and  comparable,  e.g.  linear,  monotonic,  normalized,  quantified  attrib^ute 
values. 


Potential  normalizations  procedures,  for  fixed  attribute  j  ,  where  djj  are 
comparable  unit-less  attribute  values,  and  xjj  are  transformed  quantified  observed  attribute 
values,  are: 

(1)  Vector  Normalization  where 


(i.e.  djj  =  1  for  the  norm  of  (xjj  \  j) ). 
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(2)  Maximum  Value  Normalization  where 
for  all  attributes  "more  is  better"  case 


^'j  “  max  xii  ’  ^'j  ^ 


max  xjj 
i 

for  all  attributes  "more  is  not  better"  case 


dij  =  1  - 


M. 


max  Xjj 

I 

and  for  a  mix  of  cases  among  attributes,  for  "more  is  better"  case 


dij  = 


and  for  "more  is  not  better"  case 


M- 


max  Xjj 


H-  ^ii 
max/_1 


mm  Xjj 
i 


i  Lxjj) 


Xjj 


:  dij  <  1 . 


(3)  Range  Normalization  of  attributes  where 
for  "more  is  better"  case 


dij  = 


Xij 


ij-ri"  “'i) 


I  i 

and  for  "more  is  not  better"  case 


^max  xjjj^^min  xjjj 


OJdijSi, 


dij  = 


^max  xjjY^min  xjjj 


I  i  A' 

(4)  Sum  Value  Normalization  of  attributes  where  for  "more  is  better"  case 

Xii  ^ 

“'I'm  ■  I?*') 

I  Xij 
i=1 
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and  for  "more  is  not  better"  case 

1 

xj  j 

y  “77 
i=i  ^'j 

All  of  the  above  procedures  have  advantages  and  disadvantages  [2].  As  with 
attribute  weights  estimation,  a  prudent  selection  of  attribute  transform  and  normalization 
procedures  is  critical  to  creditable  MADM  results.  For  example  transforming  observations 
to  all  positive,  linear  monotonic,  "more  is  better"  values  simplifies  the  proc^ure.  Poor  or 
biased  selections  can  and  will  adversely  affect  MADM  outcomes. 

SIMPLE  ADDITIVE  WEIGHTING  METHOD 

The  Simple  Additive  Weighting  Method  (SAW)  uses  a  single  objective  function  for 
the  selection  of  the  best  alternative.  The  MADM  formulation  is  straight  forward,  given  a 
prudent  estimation  of  attribute  weights,  and  a  carefully  transformed,  normalized  decision 
matrix  of  comparable,  quantified  attribute  values. 

Mathematically  SAW  calculates  the  objective  function  for  a  given  alternative  i,  as 
the  weighted  sum  of  the  attribute  values  [  dj.  ] .  Thus 

f*,  =  jT  (  dij  I  given  an  alternative  i )  =  dj.  W*"  =  [  dii , ... ,  din  ]  [  wi . wn  ] 

For  all  alternatives  the  calculation  is 

FiT  =  [f]  . . =  dWT  =  [dij][  wi . wn]T. 


The  alternative  i’l  that  gives 

max 
'  "I  "  i=1-to-m 

is  the  alternative  that  is  an  "optimal"  decision  with  respect  to  objective  1 .  Since  i'l  is  the 
"optimal"  overall  alternative,  i*,  for  a  singular  objective  set,  where  p  =  1  .then  i*  =  i'i 
is  the  "optimal"  decision  alternative  for  the  SAW  MADM  process. 

The  SAW  method  can  be  extended  to  a  complex  additive  method  where  several 
objective  functions,  each  with  its  own  separate  weights,  are  used.  If  the  SAW  method  is 
applied  to  the  resulting  objective  function  set  results  as  if  they  were  the  elements  of  a 
second  decision  matrix,  with  its  own  separate  weights,  the  SAW  results  are  the  weighted 
sums  of  the  objective  function  values  of  the  complex  additive  method.  An  extension  of  this 
n^  >don  leads  to  the  Hierarchical  Additive  Weighting  Method. 
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HIERARCHICAL  ADDITIVE  WEIGHTING  METHOD 

The  Hierarchical  Additive  Weighting  Method  (HAW)  uses  a  hierarchical  "best" 
alternative  selection  method  based  on  evaluations  of  a  series  of  hierarchical  "nested" 
objective  functions.  The  objective  function  calculations  all  utilize  quantitative  attribute 
weights  information. 

For  the  observed  comparable  values  case  with  m  alternatives  (hierarchical  elements 
at  the  lowest  level)  and  n  attributes  (hierarchical  elements  at  next  to  the  lowest  level),  let 
0°  be  an  m  x  n  decision  matrix  of  observed  attribute  values  over  all  alternatives.  Assume 
a  transformation  procedure  has  converted  the  observed  (quantitative  or  qualitative  /  fuzzy) 

attribute  values,  dOjj,  into  comparable,  linear  monotonic,  quantified  measurement  scale 
values,  xjj,  where  0  xjj  .  Further  assume  that  the  xjj  values  have  been  Sum  Value 
normalized  with  respect  to  each  attribute  ]  =  1 n,  such  that,  for  the  "more  is  better" 
attributes  in  the  set. 


“'J  =  m 

Z  Xjj 

i=1 


m 


;  Sdij  =1, 

1=1 


and  for  the  "more  is  not  better"  attributes  in  the  set. 


M 


m 


^  I 


I  u:: 

i=1  ^'J 


The  resulting  transformed  and  normalized  decision  matrix  D  =  [  djj  ]  has  the  character  of 
a  lowest  level  weighting  matrix,  Wh  ,  where  h  is  the  number  of  hierarchical  levels.  Each 
set  of  djj  values  for  fixed  j  forms  a  column  vector  of  D  that  is  an  estimate  of  the  relative 
importance  (weighting)  of  the  lowest  hierarchical  level  elements  (alternatives)  with  respect 
to  the  next  to  the  lowest  level  hierarchical  elements  (basic  attributes). 

At  this  point  we  have  what  is  similar  to  a  first  step  in  a  SAW  procedure  where  Sum 
Value  normalization  is  used.  If  we  let  the  normalized  m  x  n  decision  matrix  D=W3  in  a 
three  level  hierarchy,  h=3,  and  estimate  the  importance  (e.g.  using  the  ratio  matrix  method) 
of  each  basic  attribute  with  respect  to  the  single  top  level  of  the  hierarchy  element,  e.g. 
figure  of  merit  (FOM),  we  can  obtain  an  n  x  1  weighting  column  vector  matrix  W2,  for 
the  basic  attributes  with  respect  to  a  single  top  level  element,  FOM.  Since  the  FOM  is  a 
single  value,  Wi=[1]  isalxl  matrix,  i.e.  the  trivial  weighing  at  the  top  of  the 
hierarchy.  This  three  level  HAW  procedure  is  the  same  as  the  SAW  procedure  where  Sum 
Value  normalization  is  used,  i.e.  where,  the  m  x  1  matrix  of  alternative  rankings  is  given 
by 


FOM  =  W3  W2  Wi  . 

Thus  the  SAW  procedure  can  be  structured  as  a  special  case  of  the  HAW  procedure. 
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The  HAW  method  thus  has  its  advantage  over  the  SAW  method  when  the  number 
of  hierarchical  levels  is  greater  than  three. 

THE  ANALYTIC  HIERARCHY  PROCESS 

The  Analytical  Hierarchy  Process  (AHP)  developed  by  Thomas  L.  Saaty  is  a 
special  case  of  the  Hierarchical  Additive  Weighting  Method  (HAW)  [1].  Saaty's  recent 
1990  text  [2]  addresses  the  issues  of  how  to  use  the  AHP  in  decision  making.  The  text's 
focus  is  on  simple  examples,  how  to  structure  a  problem  hierarchy,  and  how  to  use  the 
AHP  method  to  assess  priorities  among  decision  alternatives.  The  text  makes  little  or  no 
mathematical  demands. 

The  AHP  form  of  the  HAW  method  has  been  selected  as  the  Naval  Task  Force 
performance  assessment  methodology  of  choice.  The  specifics  of  the  proposed  AHP 
structure  are  provided  in  the  body  of  the  text 
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ASSESSMENT  PROCESS  DETAILS 
PROCESS  PHASES 

Details  of  the  four  phases  of  the  Task  Force  assessment  process  shown  in  Figure  1  of  the 
main  text  are  shown  in  Figures  B1  through  B4  below. 


2.1  -  EXPLICITLY  DEFINE 
THE  MISSION(S)OFTHE 
TASK  FORCE 


1.0-  DETERMINE 
THE  TASK  FORCE’S 
TEMPORAL, 
GEOPOLITICAL,  AND 
GEOGRAPHICAL 
CONTEXT 


3.0  -  DEFINE  THE 
-STRUCTURED 
ANALYSIS-  CONTEXT  U 
DIAGRAM  OF  A  TASK 
FORCE  [1] 


2.2-  EXPLICITLY  DETERMINE 
ORGANIZATIONAL  CONTEXT 
OF  THE  TASK  FORCE  AS  AN 
ELEMENT  OF  THE  TOTAL 
NATIONAL  MILITARY  FORCE 


4.0  -  DETERMINE 
FUNCTIONALLY  WHAT  A 
TASKFORCE  MUST  BE 
ABLE  TO  DO  TO 
CONDUCT  IPS  DEFINED 
MISSION(S)  [2] 


5.0-  DOCUMENT  A 
STRUCTURED  FUNCTIONAL 
DECOMPOSITION  OF  THE 
TASK  FORCE,  i.e.  A 
STANDARD  FUNCTIONAL 
SPECIFICATION  OF  THE  TASK 
FORCE  AS  A  WARFIGHTING 
PROCESS  [3) 


[1  ]  NOTE:  EXPLICITLY  DETERMINE  AND  DEFINE  ALL  OF  THE  INTERFACES  OF  THE  TASK  FORCE 
ASA  -SUB  PROCESS-  OF  THE  NATIONAL  MIUTARY  FORCE  PROCESS. 


[2]  NOTE:  AT  THIS  POINT  IN  THE  PROCESS,  THE  FOCUS  IS  ON  WHAT  THE  FORCE  MUST  BE 
ABLE  TO  DO,  NOT  ON  HOW  IT  IMPLEMENTS  A  FUNCTION  AS  A  PHYSICAL  SYSTEM. 


(3)  NOTE:  FUNCTIONAL  DECOMPOSITION  SHOULD  INCLUDE  NOT  ONLY  DEFINITIONS  OF  "WHAT  FT  MUST 
DO-  FUNCTIONS  BUT  ALSO  THE  STRUCTURAL  INTERFACES  BETWEEN  THE  RELATED  FUNCTIONS.  THIS 
MIGHT  ALSO  INCLUDE  A  DESCRIPTION  OF  ALL  REQUIRED  -FUNCTIONAL  /  NOTIONAL  STORES- ,  e.g.  OF 
INFORMATION  ,  MISSILES,  BOMBS.  DATA,  FUEL,  DOCTRINE  MANUALS,  etc.,  AND  THEIR 
INTERRELATIONSHIPS.  IF  THE  ASSIGNED  MISSION(S)  DICTATE.  THE  ABOVE  MUST  BE  DONE  EXPLICITLY 
FOR  Aa  UNIQUE  OPERATIONAL  STATES  OF  THE  TASK  FORCE. 


FIGURE  B1 .  PHASE-1 :  FUNCTIONALLY  DECOMPOSE  A  TASK  FORCE 
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2.1  -  OBTAIN  THE  DOCUMENfTED 
STRUCTURED  FUNCTIONAL 
DECOMPOSITION  [STANDARD  FUNCTIONAL 
SPECIFICATION)  OF  THE  TASK  FORCE 
FROM  PHASE-1  [1] 


1.0 -DETERMINE  THE 
PHYSICAL  OPTION(S)  FOR 
THE  TASK  FORCE  TO  BE 
ASSESSED  WITH  RESPECT 
TO  THE  STANDARD 
FUNCTIONAL  SPECIFICATION 
OF  THE  TASK  FORCE  [i.e.THE 
STRUCTURED  FUNCTIONAL 
FORM  OF  THE  TASK  FORCE). 


3.0-  MAP  THE  PHYSICAL 
TASKFORCE 
OPTION(S)‘ 
IMPLEMENTING 
RESOURCES  WITH 
THEIR  FUNCTIONAL 
CAPABILITIES  ONTO 
THE  STANDARD 
FUNCTIONAL 
SPECIFICATION  OF  THE 
TASK  FORCE 


4.0 -IDENTIFY  THE 
FUNCTIONAL 
DEFICIENCIES/ 
OVERLAPS  OF  THE 
ASSESSED 
PHYSICAL 
OPTION(S) 


5.0  -  DOCUMENT 
THE  FUNCTIONAL 
ANALYSIS  OF 
THE 

PHYSICAL  TASK 
FORCE 
OPTION(S) 


2.2  -  DOCUMENT  THE  PHYSICAL 
OPTIONS  FOR  THE  TASK 
FORCE  INCLUDING  THE 
EXPLICIT  CAPABILITIES  OF 
IMPLEMENTING  PHYSICAL 
RESOURCES  [1] 


(1)  NOTE*  IT  IS  ENVISIONED  THAT  THESE  STRUCTURED 
FUNCTIONAL  SPECIFICATIONS  AND  PHYSICAL  FORCE  OPTIONS 
WITH  IMPLEMENTING  CAPABILITIES  ARE  AVAILABLE  AS 
-ELECTRONIC*  DOCUMENTS  IN  A  DIGITAL  COMPUTER 
COMPATIBLE  FORM  ALLOWING  "DATA  BASE  LIKE- 
MANIPULATION. 


FIGURE  B2.  PHASE-2:  FUNCTIONALLY  ANALYZE  PHYSICAL  OPTION(S) 


2.1  -  OBTAIN  THE  PHYSICAL  TASK  FORCE 
OPTION{S)  TO  STANDARD  FUNCTIONAL 
SPECIFICATION  MAPPING(S)  AND 
ASSESSMENT  FROM  PHASE-2 


1.0-  DEVELOP  A  TASK 
FORCE  PERFORMANCE 
ANALYSIS  MASTERPLAN 
BASED  ON  THETLWR 
CRITERIA  FORA 
-COMPLIANr  TASK 
FORCE  OPTION  AND 
ASSESS  THE 
AVAILABILITY  AND 
UTILITY  OF  ASSESSMENT 
DATA,  METHODOLOGIES.  | 
TOOLS,  MODELS;  ETC.[1] 


3.0  -  CONDUCT  A  QUANTIFIED 
PERFORMANCE  ANALYSIS 
FOR  THE  PHYSICAL  TASK 
FORCE  OPTION(S) 
ACCORDING  TO  THE 
PERFORMANCE  ANALYSIS 
MASTER  PLAN 


4.0  -  IDENTIFY 
PERFORMANCE 
SHORTFAaS/ 
OVERKILLS  OF  THE 
ASSESSED 
PHYSICAL  TASK 
FORCE  OPTION(S) 


5.0  -  DOCUMENT 
PERFORMANCE 
ANALYSIS  OF  THE 
TASKFORCE 
OPTION(S) 


2.1  -  DOCUMENT  THE  TASK 
FORCE  PERFORMANCE 
ANALYSIS  MASTER  PLAN 


(1)  NOTE :  THE  SELECTION,  DEVELOPMENT.  VALIDATION.  AND 
MAINTENANCE  OF  A  VIABLE  FORCE  ASSESSMENT 
INFRASTRUCTURE  IS  NOT  TRIVIAL 


FIGURE  B3.  PHASE-3;  CONDUCT  PERFORMANCE  ANALYSIS 
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1.0-  SELECT  A  TASK  FORCE 
OPTION(S) 

COST-RISK-SCHEDULE 
ESTIMATION  METHODOLOGY 
AND  ARRANGE  FOR  ITS  USE 
BY  THE  ASSESSMENT 
PROCESS  [1] 

~~r~ 

2.0 -OBTAIN  THE 
DOCUMENTED 
PERFORMANCE 
ANALYSIS  OF  TASK 
FORCE  OPTION(S) 
FROM  PHASE-3. 


5.1  -  IDENTIFY  NEAR 
TERM  HIGH /LOW 
PAYOFF  TASK  FORCE 
INVESTMENTS 


4.0  -  OBTAIN 

6.0-  DOCUMENT 

COST-RISK-SCHEDULE 

TLWR  COMPLIANT 

ESTIMATES  FOR  THE 

TASK  FORCE 

OPTION(S) 

OPTION(S) 

z 


3.0-  DEFINE 
TLWR 

COMPLIANT 

TASKFORCE 

OPTION(S) 


5.2  -  IDENTIFY  LONG 
TERM  HIGH /LOW 
PAYOFF  TASK  FORCE 
INVESTMENTS 


[1]  NOTE:  A  SURVEY  OF  NEEDS  AND 
RESOURCES  IN  THIS  AREA  MUST  BE  AVAILABLE 
PRIOR  TO  THE  START  OF  THIS  EFFORT. 


FIGURE  B4.  PHASE-4:  DEVELOP  TLWR  COMPLIANT  OPTIONS 
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GENERIC  FUNDAMENTAL  PRIMITIVE  FUNCTIONS 


FUNDAMENTAL  DEFINITIONS 

Level  "5"  of  the  proposed  AHP  hierarchy  is  derived  from  observing  the  utility  of  a 
generic  set  of  "lower"  level  functional  decomposition  attributes  in  previous  Warfare  Task 
functional  decompositions  [1],  i.e.  Receive,  Sense,  Plan,  Observe,  Assess,  Execute, 
Issue,  and  Act.  The  development  and  use  of  these  generic  fundamental  or  primitive 
functions  (attributes )  were  inspired  by  the  work  of  Paul  Girard  [2]. 

Plan,  Observe,  Assess,  and  Execute  are  the  generic  fundamental  functions  of 
command.  T^ey  generically  cover  the  necessary  command  functions  of  the  lowest  level  to 
the  highest  level  of  command.  They  can  be  described  as  follows: 

Observe  is  the  function  of  assembling  information  and  recognizing  its 
form  in  the  context  of  a  situation  and  its  environment. 

Assess  is  the  function  of  evaluating  the  relevance  of  an  observed  situation 
in  the  context  of  mission  objectives  and  the  environment. 

Elan  is  the  function  of  generating  and  selecting  a  course  of  action. 

Execute  is  the  function  of  formulating  the  selected  course  of  action  into 
action  directives  and  the  enforcement  of  the  directives. 

Sense  and  Act  are  the  generic  fundamental  functions  of  physically  interacting  or 
coupling  with  the  physical  world  and  its  environment.  They  generically  cover  the  functions 
necessary  to  interact  with  or  make  an  impact  on  the  real  world.  In  general  they  are  the 
carrying  out  of  action  directives  or  standing  orders  of  command.  They  can  be  described  as 
follows: 

Sense  is  the  function  of  probing  the  real  physical  world  for  information 
about  physical  things  in  the  environment  or  conditions  of  the  environment. 

Act  is  the  function  of  producing  an  effect  on  a  physical  object  in  the  real 
world  or  the  physical  environment. 

Receive  and  issue  are  the  generic  fundamental  functions  of  communicating.  They 
are  the  generic  functions  necessary  to  transfer  information  from  one  of  the  other  functions 
to  another.  They  can  be  described  as  follows: 

Receive  is  the  function  of  accepting  or  taking  in  information. 

Issue  is  the  function  of  sending  or  giving  out  information. 

When  the  above  functions  are  applied  to  a  specific  Naval  Warfare  Task  such  as 
AAW,  the  set  of  eight  functions  becomes  AAW  Receive,  AAW  Sense,  AAW  Plan,  AAW 
Observe,  AAW  Assess,  AAW  Execute,  AAW  Issue,  and  AAW  Act,  a  set  of  eight 
fundamental  or  primitive  functions  necessary  to  conduct  AAW. 
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Similarly,  when  the  above  functions  are  applied  in  turn  to  each  of  the  Naval 
Warfare  Tasks  necessary  to  conduct  Naval  Warfare,  the  result  is  a  complete  set  of 
fundamental  or  primitive  functions  necessary  to  the  conduct  of  Naval  Warfare,  and  thus  the 
successful  design  of  a  Naval  Task  Force  as  a  warfighring  system. 
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